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Purpose: To determine measurement variability of N|P| amplitudes and the R/R^ ratio in 
normal subjects and hydroxychloroquine users without retinopathy. 
Design: Retrospective, observational study. 

Subjects: Normal subjects (n=21) and 44 patients taking hydroxychloroquine (n=44) without 
retinopathy. 

Methods: Multifocal electroretinography (mfERG) was performed twice in one session in the 
2 1 normal subjects and twice within 1 year in the hydroxychloroquine users, during which time 
no clinical change in macular status occurred. 

Main outcome measures: N|P| amplitudes of rings Ri-R,, the R/R^ ratio, and coefficients 
of repeatability (COR) for these measurements. 

Results: Values for NjPj amplitudes in hydroxychloroquine users were reduced compared with 
normal subjects by the known effect of age, but R/Rj was not affected by age. The COR for Rj-Rj 
ranged from 43% to 52% for normal subjects and from 43% to 59% for hydroxychloroquine 
users; for R/R^ the COR was 29% in normal subjects and 45% in hydroxychloroquine users. 
Conclusion: mfERG measurements show high test-retest variability, limiting the ability of a 
single mfERG test to influence a decision to stop hydroxychloroquine; corroborative evidence 
with a different ancillary test is recommended in a suspicious case. 
Keywords: multifocal electroretinography, hydroxychloroquine, test-retest variability 
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Introduction 

In 20 1 1 , the American Academy of Ophthalmology (AAO) pubhshed revised guidelines 
for screening hydroxychloroquine retinopathy.' These recommended the use of what were 
termed objective ancillary tests, including multifocal electroretinography (mfERG), when 
available. ' Screening for retinopathy occurs over a period of years, typically with tests taken 
multiple times and interpretations compared longitudinally. Lithis situation, it is necessary 
to quantitate both measurement noise and short-term variation of the measurements in 
order to be able to recognize true changes that represent disease onset and progression. In 
this article, test-retest variability (measurement noise) in normal volunteers and short-term 
variation in hydroxychloroquine users without retinopathy were assessed. 

A clinical case will make the issues concrete and motivate the need for the study. 
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Case report 

A 64-year-old woman with rheumatoid arthritis was placed on hydroxychloroquine 
in 2007. She was 170 cm and weighed 84 kg. Her ideal body weight according to 
the National Heart Lung and Blood Institute table was 69 kg.^^ She took hydroxy- 
chloroquine 400 mg/day for 6 years. Her best corrected visual acuity was 20/25 in 



submit your manuscript | www.dovepress.ci 
Dovepress 

http://dx.doi.org/1 0.2 1 47/OPTH.S66S28 



Clinical Ophthalmology 2014:8 1467-1473 



1467 



© 2014 Browning and Lee. This work is published by Dove Medical Press Limited, and licensed under Creative Commons Attribution - Non Commercial (unported, vJ.O) 
I License. The full terms of the License are available at http://cfeativecommons.Org/licenses/by-nc/3.0/. Non-commercial uses of the work are permitted without any further 
permission from Dove Medical Press Limited, provided the work is properly attributed. Permissions beyond the scope of the License are administered by Dove Medical Press Limited. Information on 
how Co request permission may be found at: http://www.dovepress.com/pefmissions.php 



Browning and Lee 



Doveoress 



Right eye 



Central 10-2 Threshold test 

Threshold graytone Defect depth (dB) 



Central 10-2 Threshold test 

Threshold graytone Defect depth (dB) 




Fovea: 24 dB 

Central reference: 24 dB 




Fovea: 22 dB 

Central reference: 25 dB 





Fovea: 24 dB 

Central reference: 24 dB 





























FP: 0/7 


Fovea: 


■ ■ ww^ 

24 dB 



Fovea: 21 dB 

Central reference: 24 dB 



Central reference: 24 dB 
08-14-2012 



FP: 0/7 



Fovea: 24 dB 

Central reference: 24 dB 




B 



Left eye 



Central 1 0-2 Threshold test 

Threshold graytone Defect depth (dB) 
11-28-2007 3.9 mm 




Central 10-2 Threshold test 

Threshold graytone 
08-06-2010 



Fovea: 25 dB 

Central reference: 24 dB 






FP: 0/7 
3.9 mm 



Fovea: 24 dB 

Central reference: 25 dB 



Fovea: 27 dB 

Central reference: 24 dB 



Fovea: 27 dB 

Central reference: 24 dB 




Fovea: 27 dB 

Central reference: 24 dB 





Fovea: 24 dB 

Central reference: 24 dB 



FP: 0/7 
3.9 mm 



FP: 0/7 



Defect depth (dB) 
3.9 mm 



FP: 0/7 
3.9 mm 



FP: 1/7 
3.9 mm 



Figure I 10-2 visual fields over six years. 
Abbreviation: FP, false positives. 

each eye, secondary to early nuclear sclerotic cataracts. the AAO revised guidelines were published, mfERG testing 

Her maculas at baseline were normal. She had no renal or was began. The results are shown for 3 consecutive years 

liver disease. (Figure 2). Because of reductions in NjPj amplitudes noted 

Yearly 10-2 visual field (VF) testing with a III, red test in 2012, the question arose as to whether she had toxicity 

object was normal for 6 consecutive years (Figure 1). When and needed to be taken off hydroxychloroquine. 
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Figure 2 mfERGS for three consecutive years. 

Notes: (A) Study of 1 5 August, 20 1 I ; (B) study of 20 August, 20 1 2; (C), study of 1 9th August, 20 1 3. 



Methods 

This was a retrospective study of 21 normal subjects and 
44 patients taking hydroxychloroquine, who were free of 
retinopathy, in a private multispecialty practice with 26 
ophthalmologists and three optometrists. The 21 normal 
subjects were tested twice in a single session. mfERGs were 



recorded twice within 1 year from the 44 patients taking 
hydroxychloroquine. These patients had no change in their 
clinical condition between the first and second measure- 
ments and were not receiving toxic daily dosing. The two 
measurements provided data on short-term variation in the 
mfERG. 
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The radius of the stimulus zone was 25 degrees. The vari- 
ables examined were the R -R, ring N^Pj amplitudes, the R/ 
Rj ring ratio, the R^/R^ring ratio, and the R/Rj ring ratio. One 
eye for each subject was chosen for analysis. For each index, 
the sample mean for the combination of both trials was used to 
normalize the measurements. The normalized measurements 
were analyzed via the method of Bland and Altman to cal- 
culate the coefficient of repeatability (COR), defined as 1.96 
times the standard deviation of the differences between the 
paired measurements." The probability is 95% that a change 
in an index that exceeds the COR can be judged to be real, 
and not random variation in the measurement (noise).'* 

To avoid problems of correlated results between eyes, 
only one eye was included per patient.^ When only one of 
two eyes had good-quality testing (no 60-cycle noise and no 
evidence of eccentric fixation), that eye was chosen. When 
two eyes had good-quality testing, a random number genera- 
tor was used to pick which of the two was included. 

mfERGs were performed following International Society 
for Clinical Electrophysiology of Vision (ISCEV) guidelines 
as previously described.'-^ The mfERGs were performed with 
the Espion system (Diagnosys LLC, Lowell, MA, USA) 
running under version 6+ software. DTL (Dawson, Trick, 
and Litzkow) fiber electrodes were used. The patients' eyes 
were dilated and topical anesthetic was used. The stimulation 
pattern was dictated by an m-sequence controlling the illumi- 
nation of 61 contiguous hexagons subtending 30 degrees of 
VF to either side of fixation. The luminances of the white and 
black hexagons were 1,000 cd/m- and 0 cd/m^, respectively. 
Signals were processed through a 10-100 hertz bandpass 
filter. The first order kernel response was analyzed. The 
waveform amplitudes refer to the response density measured 
from the trough of the Nj wave to the peak of the Pj wave. The 
displays are shown in the retinal view (as though looking at a 
fiindus photograph, not as though looking at a VF). 

Waiver of informed consent and waiver of Health Insur- 
ance Portability and Accountability Act (HIPAA) authoriza- 
tion were approved by the Presbyterian Hospital Institutional 
Review Board. 

Results 

The demographic characteristics of the normal subjects and 
patients taking hydroxychloroquine without retinopathy 
are shown in Table 1 . The hydroxychloroquine users were 
older than the normal subjects (median age 62 and 38 years, 
respectively). The mfERG amplitudes from the normal sub- 
jects and hydroxychloroquine users are shown in Table 2. 
The amplitudes were lower in the hydroxychloroquine users, 



Table 1 Demographic 


characteristics of subjects 




Controls 


HC users 


Age (years) 


38 (28-55) 


62 (54-72) 


Womenimen 


19:2 


41:3 


Height (cm) 


NA 


165 (160-168), n=4l; 






not checked in 3 


vveignt ^Kg^ 


NA 


77 (64-88), n=39; 






not checked in 5 


Daily dose (mg/day) 


NA 


400 (n=22); 200 (n=l4); 






300 (n=6); not checked in 2 


Cumulative dose (grams) 


NA 


706 (406-1,066); n=32; 






not checked in 1 2 



Note: Data are presented as median (interquartile range) unless otherwise 
indicated. 

Abbreviations: HC, hydroxychloroquine: NA, not applicable. 



consistent with their increased age relative to the normal 
subjects.^ The test-retest variability in the normal subjects 
is shown in Table 3. Neither fixed nor proportional bias was 
manifest in the test-retest measurements (Figure 3). The COR 
was 16.1 nV/deg- and 7.2 nV/deg' for the averaged measure- 
ments of rings Rj and R^, respectively, the rings most closely 
assessed in evaluating hydroxychloroquine retinopathy. The 
COR for the R/R^ ratio was 0.54. Expressing the measure- 
ments in relative terms, the CORs for R^, R^ and the R/Rj 
ratio were 52%, 43%, and 29%, respectively. The smallest 
CORs were found for R^/R^and R/R, (Table 3). 

The short-term variability in hydroxychloroquine 
users is shown in Table 4. The magnitudes of the mea- 
surement differences from tests separated by months 
were no greater than the measurement differences in tests 
performed minutes apart in normal subjects. The COR 
extracted from these measurements was 16.0 nV/deg^ 
and 7.6 nV/deg- for the averaged measurements of rings 
R| and R^, respectively. The COR for the R/R^ ratio 
in hydroxychloroquine users was 0.89. Expressing the 



Table 2 Values of multifocal electroretinogram measurements in 
normal subjects and hydroxychloroquine users without retinopathy 



Variable 


Units 


Normal subjects 
(n=2l) 


HC users 
(n=44) 




nV/deg^ 


3I.4±7.9 


26.9±5.7 


\ 


nV/deg^ 


I7.0±4.5 


I4.8±3.3 




nV/deg^ 


I0.2±2.3 


9.0±2.5 


\ 


nV/deg^ 


7.S±I.8 


6.7±2.0 




nV/deg^ 


6.4±l.5 


5.9±1.8 




No unit 


I.84±0.I5 


l.83±0.23 




No unit 


0.87±0.07 


0.89±0.08 


R3/R3 


No unit 


0.64±0.08 


0.66±0.09 



Notes: to refer to ring averages of N|P| amplitudes from the multifocal 
electroretinogram. R|/Rj, R^/R^, and R5/R3 refer to ratios of these ring averages. 
Data are presented as means ± standard deviations. 
Abbreviations: deg, degree; HC, hydroxychloroquine; nV, nanovolts. 
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Table 3 Test-retest variability of multifocal electroretino| 


;ram measurements In normal 


subjects (n=2 1 ) 




Measurement 


Units 


Trial #1 


Trial #2 


COR actual 


COR, norms-lizcd 






(mean ih SD^ 


(mean ± SD) 


values 


values, % 


Ri 


nV/deg^ 


32.4±8.S 


jU.4±7.J 


1 1 
1 0. 1 


J A 


^2 


nV/deg^ 


1 7.6±4.3 


1 6.4±4.5 






n 
^3 


nV/deg 


I0.S±2.6 


9.8±2.5 




A'i 


R4 


nV/deg^ 


7.8±l.9 


7.2+2.0 


3.2 


43 


Rs 


nV/deg^ 


6.7±l.6 


6.2±l.8 


2.9 


46 


R/Rj 


No unit 


I.83±0.I9 


l.8S±0.2l 


0.54 


29 


R3/R, 


No unit 


0.87±0.07 


0.86±0.06 


0.1 1 


13 


R3/R3 


No unit 


0.6S±0.08 


0.63±0.09 


0.14 


22 



Notes: R| to refer to ring averages of N|P| amplitudes from the multifocal electroretinogram. RyR^, RJR^, and R5/R3 refer to ratios of these ring averages. 
Abbreviations: COR, coefficient of repeatability: deg, degree; nV, nanovolts; SD, standard deviation. 



measurements in relative terms, the CORs for R^, R^, and 
the R/Rj ratio were 59%, 53%, and 45%, respectively. The 
smallest CORs were found for R/R^and RJR^ (Table 4). 

Discussion 

mfERG measurements suffer from high inter-test variability, 
in part due to the technical skills of the person administering 
the test.' This limitation is not appreciated by many clini- 
cians who have been advised to use the test in hydroxychlo- 
roquine screening.' In the case report, for the right eye, R^ in 
the third study is decreased by 41% compared with baseline, 
which is less than the 59% COR for R^ in hydroxychloroquine 
users. Therefore, this change probably reflects measurement 
variability. Similar comments apply to the changes observed 
in R, for the right eye and both R^ and R^ in the left eye. R/R^ 
is not abnormal for either eye in any of the three studies. 

Some authors place diagnostic weight on individual 
hexagonal waveforms of the mfERG. There is no evidence 
that the variability of individual hexagonal waveforms is less 
than for ring averages and ratios.'" '^ 
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The overall clinical picture carries more weight than 
isolated mfERG testing. For example, the patient in the case 
report had been on hydroxcyhloroquine <6.0 mg/kg/day 
based on ideal body weight and had consistently normal 1 0-2 
VPs. There was no need to stop hydroxychloroquine nor to 
reduce the daily dose despite the decrease in the mfERG 
amplitudes in the 8-19-2013 study. 

The short-term variability of mfERG measurements in 
patients taking hydroxychloroquine was similar to the test- 
retest variability in normal subjects, as has been reported 
by other investigators."* Some have reported that variabil- 
ity of N|Pj amplitudes increases in the outer rings, but our 
measurements did not show this. The variability of the R/R, 
ratio was not better than that of N^P^ amplitudes to a clinically 
important extent. The usefulness of mfERG measurements in 
screening for hydroxychloroquine retinopathy is limited by 
their variability compared with the low variability of spectral 
domain optical coherence tomography (SD-OCT) images 
and thickness measurements, which can also be used for this 
purpose.'^ 
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Figure 3 Bland-Altman analysis of repeatability for normal subjects and hydroxychloroquine users. 
Abbreviations: SD, standard deviation; HC, hydroxychloroquine. 
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Table 4 Short-term 


variation of 


multifocal electroretinogram 


measurements 


in patients taking hydroxychloroquine without 


retinopathy (n=44) 












Measurement 


Units 


Trial #1 


Trial #2 


COR, actual 


COR, normalized 






(mean ± SD) 


(mean ± SD) 


values 


values, % 


1^ 


1 1 V / u eg 


ZD. Din/ .u 


Z/ . JXO.7 


1 6.0 


59 


R 


1 1 V / u eg 


1 *r.*rl!lj.7 


1 J.JILJ.7 


7.6 


S3 


a 


1 1 V / u eg 


O.OILZ.D 


7. JJiZ.tJ 


4.2 


47 


R 

4 


nV/deg^ 


6.S±2. 1 


6.9±2.3 


3.2 


49 


^ 


nV/deg^ 


S.9±l.9 


6.012.0 


3.0 


55 




No unit 


l.88±0.36 


l.80±0.2S 


0.89 


45 


R3/R, 


No unit 


0.91 ±0.09 


0.86±0.07 


0.19 


2! 


R^/R, 


No unit 


0.69±0.I2 


0.64±0.09 


0.24 


36 



Notes: R| to refer to ring averages from the multifocal electroretinogram. R|/R^, R^/R^, and R5/R3 refer to ratios of these ring averages. 
Abbreviations: COR, coefficient of repeatability; deg, degree; nV, nanovolts; SD, standard deviation. 



Certain mfERG variables are age dependent." The 
response densities of individual hexagons can decrease 
from 5% to 12% per decade of age." Ring amplitudes 
decrease with age at approximately 11% per decade. Both 
N| and Pj implicit times decrease at approximately 1% per 
decade."' This adds an additional level of complexity to 
mfERG analysis of patients taking hydroxychloroquine, 
because patients taking hydroxychloroquine are often older 
than the normal population from which tables of normal 
mfERG values are derived. One method to circumvent this 
difficulty is to emphasize ring ratios, some of which are 
invariant with respect to age. For example, R/R^, R/R3, and 
R|/R^ have been reported to be invariant with respect to age. 
In particular, R/R, has been reported as particularly useful 
in assessing hydroxychloroquine toxicity, with 2.6 used as a 
cut point for classification of responses as abnormal or not.^ 
Another advantage cited for ring ratio analysis has been 
better reproducibility than amplitude measurements.'^ The 
data herein do not support this notion. CORs for R/R^ ratios 
in this study were no better than for N^Pj amplitudes. CORs 
for R5/R4 and R5/R3 were smaller, but these indices have only 
been used in one report to date.^"* 

Because of the variability of the mfERGs, several 
tests should usually be conducted before deciding that 
hydroxychloroquine should be stopped, if other tests have 
not clarified the patient's status. Otherwise, one might stop 
a useful drug based on a decrease in mfERG amplitude 
that in reality reflected only intersession variability of the 
measurements.""^^ In fact, some investigators think that 
the sole purpose of the mfERG is to raise suspicion, with 
other tests necessary to confirm or disconfirm the pres- 
ence of retinopathy.-"^-' At the other end of the spectrum of 
hydroxychloroquine retinopathy, the value of mfERG in more 
advanced cases has been questioned; if a more reliable test 
such as SD-OCT shows retinopathy, mfERG adds little.^'-^^ 



The limitations of this study include relatively small 
numbers of normal subjects and patients taking hydroxychlo- 
roquine. In addition, mfERG results vary across instruments, 
laboratories, and testing conditions, making it difficult to 
generalize to other settings. 

Conclusion 

These results provide estimates for variability in mfERG test- 
ing among patients being screened for hydroxychloroquine 
retinopathy. Caution against over-reliance on the results of a 
single mfERG test is warranted. Corroborative testing with 
other modalities such as the 1 0-2 VF and SD-OCT are indicated 
before stopping therapy based on an abnormal mfERG test. 
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